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Abstract 



The differential distributions in rapidity and angles of the secondary lepton in the associated 
production of the top quark pair and higgs boson in proton-proton collisions at the LHC 
are quite sensitive to the top-higgs coupling. However, the effects of anomalous couplings 
of the most general tih interaction with operators of dimension-six that are clearly visible in 
the signal of the associated production of the top quark pair and higgs boson are to large 
extent obscured by the background sub-processes with the same final state. This means that 
analyses of such effects, in addition to higher order corrections that are usually calculated for 
the on-shell top quarks and higgs boson, should include their decays and possibly complete 
off resonance background contributions to the corresponding exclusive reactions. 
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1 Introduction. 



Associated production of the top quark pair and higgs boson was proposed as a sensitive probe 
of the top-higgs Yukawa coupling g tt h at the e + e~ linear collider (LC) [T], [2] more than 20 
years ago [3J. A clean experimental environment of the LC seems to be the best place to 
study the higgs boson profile, including the measurement of g tt h, but the project of LC is still 
at the rather early stage of TDR. Fortunately, the top quarks are copiously produced at the 
LHC that, among others, allows for more and more precise determination of the top quark 
pair production cross section and for measurements of the cross sections of ti + jets, see |1] 
for a review. The measurement of production of ti + bb [5J is particularly interesting, as it is 
relevant for observation of the associated production of the top quark pair and higgs boson, 
with the higgs decaying into bb. The latter should be the dominant decay mode, if the new 
boson at a mass of about 125 GeV observed at the LHC [6] is indeed the higgs. 



The associated production of the top quark pair and higgs boson in the proton-proton collisions 
at the LHC 



is dominated by the gluon-gluon fusion mechanism. Taking into account decays: h — >■ bb, 
t — > bW + , i — > bW + and the subsequent decays of the IV-bosons, one should consider hard 
scattering partonic processes as, e.g., 



corresponding to one of the Ws decaying hadronically and the other leptonically. Reaction 
(j2J) receives contributions from 67 300 Feynman diagrams in the leading order of the standard 
model (SM), in the unitary gauge neglecting masses smaller than m^, of which barely 56 
diagrams constitute the signal of the tih production and subsequent decay. Some examples of 
the Feynman diagrams of fl2]) are shown in Fig. [TJ The 56 signal diagrams are obtained from 
those depicted in Fig. QJa),[]Jb) and[]Jc) by attaching the hbb-vertex to other top or bottom 
quark lines, interchanging external b and b quarks in each of the figures and interchanging the 
two initial state gluons of Fig. H{c). The diagrams shown in Fig. [IJd), (He) and[T]T) are just 
a few examples of the background contributions to associated production of the higgs boson 
and top quark pair. 

A question arises whether the associated production of the higgs boson and top quark pair 
can be sensitive to possible modifications of the SM top-higgs Yukawa coupling or not. The 
question will be addressed in this work by showing how the distributions of the secondary 
lepton are changed in the presence of such modifications. The distributions computed with 
the signal diagrams only will be compared with those computed with the full set of the leading 
order Feynman diagrams that will demonstrate how the background contributions obscure 
relatively clear effects of the anomalous tih coupling in the signal cross section. Although the 
issue may seem somewhat premature from the experimental side, but in view of the excellent 
performance of the LHC, it may become relevant in quite a near future. 
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Figure 1: Examples of the lowest order Feynman diagrams of reaction ([2]): (a), (b) and (c) are 
the signal diagrams of tih production, (d), (e) and (f) are the tih background contributions. 
Blobs indicate the higgs-top coupling. 

2 Calculation details 

The calculation is performed in a fully automatic way with a new version of carlomat, a 
general purpose program for Monte Carlo computation of lowest order cross sections [7] . The 
most general Lagrangian of tih interaction including corrections from dimension-six operators 
that has been implemented in the program has the following form [8] 



where g t ih = m t/v, with v = (v^Gf)" 1 / 2 ~ 246 GeV, is the top-higgs Yukawa coupling. The 
couplings / and /' are assumed to be real. They describe, respectively, scalar and pseudoscalar 
departures from the purely scalar top-higgs Yukawa coupling of SM. The latter is reproduced 
for / = 1 and f = 0. 

In carlomat, the on-shell poles in propagators of unstable particles, both the s- and t-channel 
ones, are avoided by making the following substitutions: 



where the particle widths are assumed to be constant and the square root with positive real part 
is chosen, see [7J for details. In order to minimize unitarity violation effects at high energies 
caused by substitutions (jlj), which correspond to re-summation of one particle irreducible 
higher order contributions to s-channel propagators, the computation is performed in the 
complex mass scheme (CMS), where the electroweak (EW) couplings are parametrized in 
terms the complex EW mixing parameter sin 2 9\y = 1 — M w / M| which preserves the lowest 
order Ward identities [9]. Note, that the electric charge ew can be defined as a real quantity 
in terms of aw 



£>tih = -Qtiht (f + if Is) th, 



(3) 






with 
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as it enters all the EW couplings multiplicatively, which is our choice in the present work. 
The only effect of using the complex masses of in Eq. (j3J) would be the overall change of 
normalization of the cross section. The top-higgs Yukawa coupling is defined in the CMS by 

i.e., it is a complex quantity, as it is parametrized in terms of the complex masses of fl4]) and 
complex EW mixing parameter sin 9y/ . 



3 Results 



In this section some results for the differential cross sections and distributions of reaction 

pp bbbudbfi^u^ (7) 

at y/s = 14 TeV are presented. For the sake of simplicity and easy reproducibility of the results, 
only one hard scattering process (j2J) that dominates at that energy is taken into account. It 
is folded with CTEQ6L parton distribution functions [10J at the scale Q = 2m t + m^. 

The initial physical input parameters used in the computation are the following. The strong 
coupling between quarks and gluons is given by g s = \Z4ira s , with a s (mz) = 0.118. The 
EW couplings are parametrized in terms of the electric charge of (jSJ) that is kept real and the 
complex EW mixing parameter sin6w, as described in Section 2, with the EW gauge boson 
masses and widths: m w = 80.419 GeV, IV = 2.12 GeV, m z = 91.1882 GeV, T z = 2.4952 GeV 
and the Fermi coupling Gp = 1.16639 x 10~ 5 GeV -2 . The top quark and higgs boson masses 
are: m t = 173 GeV, = 125 GeV and their widths that are calculated to the lowest order 
of SM are the following: T t = 1.49165 GeV, Th = 4.9657 MeV. The 6-quark and muon masses 
are also kept non zero, but their actual values: = 4.5 GeV and = 105.65837 MeV, are 
numerically irrelevant in practise. Masses of the light quarks of (J7|) are neglected. 

Jets are identified with their original partons and the following cuts on the transverse mo- 
menta Pt, pseudorapidities T], missing transverse energy Ifi T and separation Ai?^ in the 
pseudorapidity-azimuthal angle (if) plane between the objects % and k are imposed: 

Pti > 30 GeV, p Tj > 30 GeV, \rji\ < 2.1, \rjj\ < 2.4, 



$ T > 20 GeV, AR ljdj = - Vk ) 2 + - <p k ) 2 > 0.4, 



(8) 



where the subscripts I and j stand for lepton and jet Cuts (|S]) should allow to select events 
with separate jets, an isolated charged lepton and missing transverse momentum. 

Moreover, 100% efficiency of b tagging is assumed and events of the associated production of 
top quark pair and higgs boson in reaction ([7]) are selected by imposing the following invariant 
mass cuts: on the invariant mass of two non b jets, b^ and b^b 2 , 



60 GeV < 



1/2 



< 90 GeV, 



(9) 
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on the transverse mass of the muon-neutrino system 



K + 2 



m l + 



->T 



1/2 
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2pJ 



.1/2 



< 90 GeV, 



on the invariant mass of a 6 jet, bi, and the two non b jets 



1/2 



m t 



< 30 GeV, 



on the transverse mass my of a b quark, 6 2; muon and missing transverse energy 

m t - 30 GeV < m T < m t + 10 GeV 
and the invariant mass cut on two b jets, b% and 64, 



(Pb a + Pb A 



1/2 



< m 



cut 
bb > 



(10) 



(12) 



(13) 



with either m^* : 
mass defined by 



20 GeV or, more optimistically, = 10 GeV. In f|T2|) . my is the transverse 



m 2 + 2 



m 2 + 



-tj 1 —tT 1 
Pb 2 + Pu 



1/2 



with m being the invariant mass of the system given by m 2 = (pb 2 + p^) . Cuts (l9|)-f fT2|) 
should allow to identify the secondary W bosons, the top quarks and the higgs boson. They 
were used before in the context of the associated production of the top quark pair and higgs 
boson in e + e~ collisions at the LC |11] . 

The tih couplings / and /' of ([3]) are assigned arbitrary, positive or negative, values of order 
1 and the differential distributions of the final state muon, generally referred to as lepton, 
of reaction are computed, first with the 54 signal Feynman diagrams of the associated 
production of the top quark pair and higgs boson and then with the complete set of 67300 
Feynman diagrams, as discussed in Section 1. The rapidity and angular differential cross 
sections and distributions of the lepton for which the effects of anomalous couplings are best 
visible will be shown in Figs. [3H6] and the distributions in the lepton transverse momentum or 
energy which are practically not affected by the couplings will not be presented. 

The size of background contributions to the associated production of the higgs boson and top 
quark pair in pp collisions at y/s = 14 TeV is illustrated in Fig. [2} where the differential cross 
sections of ((7|) are plotted as functions of the muon rapidity, yi, cosine of the muon angle 
with respect to beam, cos^jb and cosine of the muon angle with respect to the reconstructed 
higgs boson momentum, cos^. The cross sections plotted in Fig. [2]have been computed with 
different cuts. In the left and central panel, the boxes shaded in light grey show the cross 
sections computed with cuts flS]) and the grey boxes depict the cross sections calculated with 
cuts ([8]) and the invariant mass cuts (l9l)- (fT2"]) . These results are not shown in the right panel of 
Fig. [21 as it is in principle not possible to reconstruct the higgs boson momentum without cut 
( flBl on its invariant mass. The short-dashed (dotted) lines show the results for = 20 GeV 
(m^* = 10 GeV) and the solid line in each panel of Fig |5] shows the results for the signal cross 
section calculated with rrf^ = 20 GeV. It should be noted here that the signal cross section 
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is fairly independent of m^*. As can be seen, the background is quite large and decreasing a 
value of seems to be a right way towards its reduction. 

Distributions in 3 different kinematical variables of the final state lepton of (J^J): rapidity, yi, 
cosine of the angle with respect to the beam, cos 9i\> and cosine of the angle with respect to the 
reconstructed higgs boson momentum, cos 9ih are shown in Figs. |3H5j In each of the figures, 
the left panels show the tih production signal, computed with 54 Feynman diagrams, and 
the right panels show the complete leading order predictions, computed with 67 300 Feynman 
diagrams. The grey boxes show the corresponding SM results, i.e. the results obtained with 
/ = 1 and /' = 0. Cuts (p))- (P)) and flBJ with rrf^ = 20 GeV are applied to all the 
distributions presented. A relatively clear effect of the anomalous couplings / and /' that can 
be seen in the tih signal distributions on the left hand side of all Figs. [3H6] is to large extent 
obscured by the background contributions in the plots on the right hand side which show the 
full leading order results. 

In order to illustrate what a role invariant mass cuts (18])- (TT3]) play, the distributions of the final 
state lepton of at yfs = 14 TeV in yi and cos 6^ with different cuts are compared in Fig. [61 
The left panels show the distributions with the cuts given by ([8]) and the right panels show the 
distributions with cuts (l8])- (fl2]) and ( fT3l) with = 10 GeV for two different combinations 
of the scalar and pseudoscalar tih couplings of (|3]). Again the grey boxes show the SM results. 
Although the invariant mass cuts suppress the background contributions to some extent, the 
degree of suppression does not look very satisfactory. 




Figure 2: The differential cross sections of (J7J) at yfs = 14 TeV as functions of the muon 
rapidity yi, cosine of the muon angle with respect to beam cos^b and cosine of the muon 
angle with respect to the higgs boson cos Q\h computed with different cuts as described in the 
main text. 



4 Summary and conclusions 



The differential cross sections and distributions of the final state lepton of (J7|) in rapidity, 
cosine of its angle with respect to the beam and cosine of its angle with respect to the recon- 
structed higgs boson momentum have been computed to the leading order in the presence of 
most general tih interaction with operators of dimension-six. The distributions computed with 
the tih signal diagrams only, which are substantially changed in the presence of anomalous 
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Figure 3: Distributions in rapidity of the final state lepton of (jTJ) in pp collisions at y/s = 14 TeV 
with different combinations of the scalar and pseudoscalar tih couplings: tih production signal 
(left panels) and complete leading order prediction (right panels). 



tih couplings, have been compared with those computed with the full set of the leading order 
Feynman diagrams. The comparison have shown that the background contributions to large 
extent obscure the relatively clear effects of the anomalous tih coupling in the signal distri- 
butions. This means that analyses of such effects |12| . in addition to higher order corrections 
[13] that are usually calculated for the on-shell top quarks and higgs boson, should include 
their decays and possibly complete off resonance background contributions to the correspond- 
ing exclusive reactions. The only reasonable way to make the effects of anomalous couplings 
better visible seems to be imposing more and more restrictive cuts. 
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Figure 6: Distributions of the final state lepton of ((7|) at y/s = 14 TeV in yi and cos#zb with 
the cuts given by (jSJ) (left panels) and (|g])-(fI2]) and with mX = 10 GeV (right panels) 
for different combinations of the scalar and pseudoscalar tih couplings. 
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